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Imas^ processor used in medical imaging system, cUsplays input 
annotation based on input positional Information of annotation where it 
lias to be added to image data 
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H04N 1/387 

Novdty: The annotation position input units (2,3) input the annotation along with 
the positional infomnation of the annotation where it has to be added to image data. 
An annotation dsplay unit (4) displays the annotation based on the input positional 
infonmtion. 

Use: For measurenient in medical imag^g sysiem such as X-ray computer 
tomograi^y device, ultrasonic ima^rg device, magnetic resonanoe ima^g ^4R0 
device. V 
Advantage: Preservation of the annotation added to the voxel data set is perfomied 
ea^y and addiljonal display of annotation is also perfomied effectively. 
Description of DFa'wing(s): The figure shows the schematic diagram of image 
processor. 
Input units 2,3 
Display unit 4 
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1 .This document has been ti^Iated by cqinputer. So the translation may not reflect dbo original precise^. 
2.**** shows die vriiudi can not be txandatfid 
3Jn the drawings, any wards are not translated. 



CLAIMS 



[Claiin(s)l 

^3aim l] An image processing system diaracteiized by having an annotation location fapit means tp associate and 
add ppsitiooal mfbmation of said annotation to said three-dimension image data in an image piooeasing systnn ^diich 
can add and display an annotatiQii on tiuee-dimension hnage data, and an annotation display means which disphys diis 
annotation based on positional information of said annotation. 

[Chdin 2] Said aimotation location it^ot means is an irii^ processing characterized by 

addmg by assodathg positional information of aaid amiofation to one [ at least ] image data mono n y^nnm rtrf rniaiiA 
araMFRimage. 

[CLiini 3] Said aimotatiim location bspat means is an image processing system given in cittiet of claims 1 or 2 
Ottwteriaed by addfa^ positixmal hifbrmation of said annotation to image data of a plane cut hnage of two or more 
Sheets, or a MPR im^ge. 

[Cla tttt 4]Sa id annotation display means is the image pcocesshsg system of any one publication in daims 1-3 
oiaractenzed by di^yfa^g said annotation based on posldonal informatUm associated to one [ at least ] 6i 
amoiig a plane cut image or a MPR hnage, 
[qai m 5] S aid a nno t ation display means is the image proccssh^g system of any one pubiicatien in claims 1 -4 
diamctezized by adding posidonal information of said annotation to image data of a phme cot unage of two or mom 
sbeets, or a MFR leoage. 

[C^ii 6] Said annotati<m dkpky means is die image processing system of any one publication hi claims 1 -5 

<»axacteiiMjd by havh^g an annotadon di^lay-control means whidi carries out a display / nonrdi^l^ control of said 

annotation according to physical mlatxon^ of a cutting pbne displayed at least m <me side anxms a plane cut hnage 

^a MFR image, and positi^infonnadonof fte thickness diractioawfaete said annotation ms added. 

[Claim 7] Said annotati^dispbqf'cottt^ pnacessfaig systemaccoidiQg to clahn6 ehaiacterized by 

equ^plng ezbitiation wiaaseiectalble d&play sdeclianm fbr^ di^lay/un-displayhig for said each annotation of 

evecy. 
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DETAILED DfiSOUPTION 



[Detafled Description of the Invention) 
[0001] 

piw tedmicalfidd to whidi invention bc^^ TUs invention rebtes to Ac image processing system wldchpeifonns 
an tfflage proecssiny for At purpose of diaffi««hV ^^i^pinf^ or iQeagurgTy^ftnt in a medical iroge system e tc. 
[0002] — • 

Cp^scrqrtlon o f &e ?mt Art] In the X-ray CT which is medical image diagnostic equipment, MRI, an ulttasonic 
diagnostic imaging eqoipment» ctc^ voxel data (Voxel Data) is referred to at drawing 9 based on collected 
meastnement data is created Aft^ creating this voxel data« the operator is cceadng images, such as volume rendeting 
(Vohmie Rendexm^ and MPH (Midti-PIanar Recanstmction), for the pmpose. 

[0O03] FjirliicnporCi an op erator adds an annofation (AnotatioQ) 'on i ^ie imafy created for Ifae purposes, snch as an 
opg^op plan ai^ infinme d conaeiit anformedOttttent), The a nnotation poinfed oct lieie is deflm?d as follows anH let 

cin and tettwhichitfe added to tfae SBoa of intSest on an image etc. for the explanation to a thiiiS 
Oftt comment. One example of fliis annotatjon in rfmum m drawing 10 \ 



person, W ^ 

[OQ04] fonydical magg. da^iostle efpnpment etc^ the needs of the tiirce-dimcnsion diagnostic 

:9anyiiig m^kE vvement hi the spieed of &e scan speed for data coUectroQ or development of dnee-dimeDsionscan 
technology are increasing. Fm«ienDore» creaticKiof anuHeractive (bitmictive) hnage is demanded mdi an operation 
plaii or generalization of informed eonseoLTfae^^^ 

to provide a hiefa speed with an image. Tbas^ Aa imagft irfiiA fa gftw^lly a? 
fhe fanages ofiGMd, and is used is explafaked 

[0005] ( 1 ) Rfsideiing hnage drawing 11 h the mimetlo diagram of volume fOKleting proces sbsg to die voxel data set 
17. B r^Wypg . U is t ^ opposed to / especiaUy / of projection 1 8 ] the nnmetic diagram of parallel projection widi 
all perpendicnlar projection light 22. Vohnne rendering 




I f -1» Witt I I 



nnag9 generated emplane of projection 18 at tins time. Plane 
oi]TOjectioa 18 and projection Ught 22 can be set iqtwitii an easy equation, if fbexarzc^ 
Moieovei^ an <^>erat6r can set I9> in Ae direction (die direction 
VDxd data set 17^ or can set np finely fhe paian^ used hi ihe case of c 

[MOT] (2) MHL image dtawjng.l2 (A) is die miindtf e diagram of die MPR proeefising ^wiiich generates the MPR image 
23giioiwnin4r4W?ttg ^2(B)froma vcrol data set An c^ierator sets die eutiigg plane 19 of the aibitxationivfaicfa 
Ms the voxd data set 17. Ai this tiine, a cutting plane 19 stores m 19thevalueof 
me voxel wtidi crosses die voxel data set 1 7. If it pote m anotlMr way, it will be die tm-^eruAAniA imagfe ggnenite^i 
by the hnage pixel on a cutting plane 1 9 in the MPR hnage 23 . Interpol^don processing of die voxel data may be 
suitably cazxied oot in die ease of storing of data, A inafliematieal es^res^ 
perfornxdosing a i^c^aogolar coordinate system. 

[0008] (3) nane cot hnage drawmen (A) is die mfanedo diagram of die plane cut (Plane Cut) processh^ which 
generates die plane cut inwgB 20 Ot is hesceafter described as PC 

drawing a (B) is die numetic di^r^of die PC hnage 20 generated by plane cut ptocessmg of drawteg 13 (A). 
AnboQ^ plai» cut proeessmg is shniltf widi MPR processii^ in diat d^ 

19 v^ch an operator sets op, it is die image widi which dw PC hnage 20 projected die crossover field (continuous 
tono pardon of ^wfa^li3 (A)) of a ammg pkne 1 9 and die voxel data set 1 7 on plane of projection 1 8 to a MPR 
iffl^beh^ an hnage genexated one cuttmg pbme 19. [0009] AlduHigh tractog is petfimned mthe direcdon which 
goes to piano of frojeotion fiom a view 23 bi case die PC image 20 is furdiennore generated the voxel which exists 
betweena view23 anda catdngpUne 19 among die voxel on light at this dme is dlsreg^d Moreover, it sees fioma 
new 23 and die voxel data set 17 of a side is also disregarded fiom a cutti^ 




after 



icmovmg au me voxel oet^cen a view 23 and a cuttmg plane 19, fa die 

projected die sur&ce (crossover field widi a cutting plane) of die voxel data set 1 7 on plane of projection 18. 
J^^' " ^ ^^8^^^ usuaUy rendermg hnage 2 1 is generated by fields other than PC unage. 
S -ZJZ!!!^* ^ ^ ^ ^ nccessarfly need to be only one image, and two or more PC images 20 
inay be genmted on one plane of pn^ection. In diat case, what is necessary is just to repcfrt die conmutarion explained 
f™??!**' cwtthig plane 19, aldiough It is necessary to carry out the multi^teroent of die euttmg plane 19. 



(Ptobktt<8) to be Solved ly ibc invatioik] Howevei; Ac annotation 
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beibichand created from voxel data to addition. In tlie way of adding an imnfytati^ to 



image created 



fiom such voxel data» or a MPR image, interactive creation of an image and addition of an annotation, and a display 
cannot be pcrfbnned. r / 

[0012] moreovo', thxe^-dunenslon - a two-dimensional image - differing since the treatment ©r 

infenmtioa is needed, even if it adds flie annotation to voxel data simply, it becomes only the fixed display and the 
display of the ef&ctive annotation acc^oiding to tiie depth cannot be pcrfomied 

[0013 ] This invention adds the annotation to voxel di^ beforehand, and m case it creates the image for which an 
operator asks, it is to offer the image piocessing system which di^lays an annotation hiteraetlvely and effectively. 
[0014] 

[Means for Solving the Problem] Let it be a sohxtion means to have an annotation location inpat means to associate 
Bod add positional infoxmation of said annotation to said three-dimension image data, and an annotation di^lay means 
vdiich displays dns annotation based on positional hifoxmation of said annotation widi an hnage processiiig systtan by - 
^iiich it is diaract^— — ^- ' * *' ' - ^- - ' 



in an image processing system which can add and display an annotation on tfiree-dimensi<Mi 
miage data in dus invention acoordiiig to clafan i hi Older to solve tf^ 

[00 1 5] Moreover, m 4us invention according to dahn 2, said annotation location ii^mt means makes it a solution 
tneans' to add by associating positional bifonnatlon of saM annotation to one [ at least ] image data among a plane cut 
m^e or a MPR hnage with an image processing system accoiding to daira 1 by vAich it is charactciiaxd. 
[ODl 6] Moreover, fai dns invention accordhig to claim 3» said annotation location input means it a solution 

to add positional infonnati<ni of said annotation to hnage data of a plans cut image of two or more sheets, or a 
MPR miage with an image processfag system of a poblication at citfaer of claimn I nr ^ hy ^it^h ^ f > rbannjffTiTjffd 
[00171 Mweover, inflds mvention a oc w dtog to elahn 4, said annotatioiii display means makes it a sohition means to 



diqday said annotatian based on positional hiformation associated to one [at 1^] hnage ^aoK^ a phnus cut 
image or a MPR image with an hnage ncoccssing system of any onB pahHeatiftti h% etftitn^ 1-3 by which it is 

cr 



(00 1 g] Moreo vcr» in tiiis faivendon according to dahn 5. said annotation di^lay means makes it a solution means to 

add positional information of said annotation m imago data of a plane cut 
TOge wi^m hnage process 

[0019] m this mventlon aco<Mdh<fe to claim 6 moceoiverp mid annotariftn rftjyijy «iM»tift ffwt^ ^^^i^^^yfgi diitrhy-^irtrftl 

means which carries out a di^y / noor^iqEd^ 

oj^tagplano d!^(dqred at 1^ 

ntdeness directiim where saU annoialioii was a^ 

system of ai^ one pubUcatioa m dahns 1 *5 by viMck it is diaraoterised 

[0020] Moreover; fa this mventiOT accordfag to clau^ 

m«sans to eqmp arbitrntion wiOia sdect^lc display selection means a^r a disph^/un-diqplayh^ Ibr said each 

anzKktation of eveiy wiOi an hnage proceasmg systemaccocdh^ 

[0021] . ' . 

CEinbodhneot of die Invention] The hgwt iiietiipdof an annotatfon iismg the hnage proccsshig system by the gestalt of 

c^mthm of this mvmilion is ej?>l^^ 

leoderiqg fanage, PC hnage, and a MPR image images. 

f0O22] Syawj^ig I shows Che'outlnie feoplainthedie ooniignration of tiie image piacessmg system by the gestatt of 
operation of tiiis invention. 

(0Q23] Fixst; it consists of a pcunting device 2 vvhich co^ 
arifiimetic unit 1 Ibr peifomdng predeteimmed data processii^ and ac^^ 
^a cuttiqg plane, akeyboard3 used Ibr achiation of an imqgei^^ 
di^>lay device 4 wlddi oonstft of bases. 

pKki4] Mofoovei; ^^ssll&^id anexaznpfe fiir ajqdammg the configuration of a di^lay of the display screen of die 
image pmoesshig system by this inventioo. die screen w^ 
are diown as &e actuation screen whidi a divisicm mdkaticni of &e sc^ 

ScrecnB in drawing 2 . and the 



III l«l 



given fiom die Chieeoonteolsofa display^ and is slwwn as S«een A in drawing 2 y _ 
screen whidi displays the MPR hnage Aown in Screen C in djaa^l^ 

[OO Zgj Am ong thes^ the c^itional feature of die voa»l dataaet whidiisnottUustrated, ^ fa^fimethmof mai^ 
^^meteis, such as a view kcadon teqnired ui order to 

fbocdoa of the cuttmg ptaae for cmatmg a MPR hnage and PC image, etc. are displayed on Screen A displayed as an 
amatum fiCfeen as a user huerftce. Moreover, die aforementioned pointiog device 2 is used for die alter operation to 
Vas actuation screen. Below, order is eaqdaioed for the alter m^eration to dus actu^don screen later on for every phase 
of 1-7. 

[|^2^ [Step 1] An operator fhst chooses the voxel data set whidi opM^ 
KejAxiaid 3 aceordii^ to die actoatioii screen di^i^ on Scr^ 

^27] [^ 2] An opttator creates the rendering hn age S ftom die selected vofcd data set The pmpose is for grasping 
? ^^"""""^^Z^^ otuect domam fiom the^imtring hnage 5, and recogi«dAg-*e physical relationship of 

an a«a Of mtqestmtd an overview. The acated rendering hnago 5 is displayed on Screen B of drawmg 2 . In aAHtimi. 

^^^^^^^^^^[^'^^^ 
^S'S^S't^ntS^ 

[0O28J [Step 31 As shown hi Screen B of AssSngl , the P^ 
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created at step 2. Moreover, an operatot enables it to obsexve an area of idtettst by adjustiDg Oe view location of 
tendering image and the location of a cutting plane ftom the direction for which it asks. Ite crealed PC image 6 is 
dispbyed inpiles on dw lendeiii^ image 5 created at 51^ 2. 
[OOM] [Step 4] A aeliip of <ho cutting plane to creating die PC imag^ 

Turing flic cutting plane by tiw computer. The created MPR image is displayed on Sctecn C aa ahown in dmwinft 3 , 
[0030] IStep 5] Next, an operator inpnls an annotation on Screen C of drawiiiy 3 . Screen C ahown in Aawing 4 is one 
of diem. An annotation 8 is ♦ •*^e^ by a gnqphio form and the text In die actuation screen shown on Sereeo A of 
Msdqgl , die user inter&ce for gr^hio fonn edit or text editing possesses. Hiese edits ate peifonnedby operatiiffi 
me pomting device 2 and keyboard 3 of drawing 1 . 

[003 1 ] [S tep 6] Tbe location diqdayed on die annotation 8 edited into die degree i$ registered . An operator operates a 
pointiiig device 2 and registccs die location ofan annotation 8. Ifonc on die MPR image 7 is specified by tbe place 
^cer 9 as shown In fawyagj , die locatioa of die point will be rpgistered as a location of an annotation 8- The 
yatiTOofdic point can be easily capressed> if die 1^ 

Smce die xegistzation location of an annotation 8 is a pohit which exists on a cuttii^g plane, if&eratSng^^ 
e3q»es^ widi die rectangular ooordinale aystcn^ d^ 

[0032] [Step 7] If edit and frustration of one annotatiftn ft p>T^ nniiplp^ ^ rrficat and a TOIiired nn^^ftf 
annolatmns 8 witl tw> T^glcf^^ ^r^^jj^^^^i^ ^ BfrpLg- 

[0033] As ment io ned above, from stq) 1 to dw step 7 is die mettiod of re ^ dstering an annotation 8 to a voxel data $§t 
Althou^odit and registration ofan annotation 8 were pei^^^ 

incntioncd «g>Ianation, it is also possible to ncifam edit and reriatratioa of an annotation 8 on th e PC image 7. as 
shown in iiawlagjj . Even in dds case^ afaiee die legis&adoii location of an amiotadon 8 is a ponxt wU(»h exists en a 

piano, if flifi cutting plane is eijnwsed widi dM 
n^gisteaing pcdnt caii be aeascfacd fer easily. 
[0034] Nead^ how to di^lay die registered annotation is esq^lained. 
[00351 [Stqi 1) First, an operator does ahw qpeiation of a poin^ 
actuation soeen displayed on Screen A^ and chooses a desired voxel data set 
[003jg A [step 2] cye^ 

S is me same as diat of din exampte diom in Screen B of ^nada^ 
ttnio h^ tint h is not neoessaiily die same as diat of dw 
aonotstion 8. 

|0C3^ 3] operator sets up die cuttiiig plane for creating die 
2. l^PC image 6 generated at dds time is the same as diat of die exanipU o 
created at dds time hopes diat it is not neoessaiily die same as that of die PC ima^ 

uiput of ana nmr t ati o n 8. Ntoeovcr, besides dw PC imaged, die MPR inngp 7 tising die same cutting tilane may be 
generated ainomaticalfy and diqilflo^ / 
[0038] [St^ 4] aridm»tic unit 1 jnd^ wh^ 
tfanee^dsta, When a r^tra t ionlocad fl tt easts, a^ 

MPRuna^7« The displ^ hiSimiatiQnifvhschniay be die fixed display m^mmtion and can carry out a leois^udzatitHi 
colloctioo by die PC toage 6 or die MPR image 7 is ilso available f« 

«P«rater IS able to set 19 a displ^ / un^laying vsh^g a pohidng device 2. [ of an annotation 8 ] * 
^0»l(Step 5] operatic resetting of a 

stopped gristing on a cuoiog plane from on a screen. And dia tamattHim a nf rtgktmtimi Vrr?fwn v /^^ *^'f tff ft 
a new cutting plane is displayed. 

[0040] Bya serks of actuation of step 1 to die above step 5, whenever an qmator changes a setup of a cutting plane, 
* OBOtadoQ 8 registered be&refaand on die PC image 6 or d^ 

jg^k ail method of whedier the ipgjgtration location of an aunotation 8 exiata on a ' ?^ ^t^^z P**^ ^* 

[0042] The rqgistradon location 10 of a cutting plane II ^ 

eoordinatesystetn(xy,z) fixed to die vozd data set Uasabove-mei 

eaqiressed fay die finUowing (1) fbnnnhL 
[0043] 

The fixmula expresslt« a cutting plane: a»x+b*y*^*i=d 
However, (a, l|,c) are taken as die unit nnnnal vector of j 

[0044] ta» - an annotation - dgjit - registration - a location - tto 
n^tratum a location ^ ten - a cutting plane ~ 12 - disto 

[0045]' 

(xy, z) HXpi Yp,2p) -n*(a,b, c)~(2) 

If fltts^oaT of die simultaneous equations wMch consist of an equation (1) and an equation (2) is calculated, die 
[00461LUhs<T)^(3) or-rs-^ 

However,abs()istakenasdiefunctionwhichgivcsanabM^ BtST AVAILABLE COPY 
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rAA<^l T 8 can be v^justed by acBiutiiig (fais OiKsbaiil H 

Si'iSS!?' t" ^S^*™';?'**?^ ^ ««««« to eqness die botHm of tbe vaxd by tba octangular 

LcaEpbinedAbo 



— — — «M«vTvnujMiuivMVU upCKUUUIl IS wn^ ifif 

tedmical rai^ of tiik uivenliQu, or equal objects. 



I design cfaaiiges 
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